Video distribution system for live distributing video containing animation of character object generated based on motion of distributor user, video distribution method, and storage medium storing thereon video distribution program

ABSTRACT

One aspect of the invention relates to a video distribution system for live distributing a video containing a virtual space and an animation of a character object generated based on a motion of a distributor user. The video distribution system determines, when receiving from a viewer user watching the video a participation request to request participation in the video, which one of first and second groups the viewer user belongs to. If the viewer user is determined to belong to the first group, the video distribution system arranges a specific avatar of the viewer user in a first region within the virtual space. If the viewer user is determined to belong to the second group, the video distribution system arranges the specific avatar in a second region within the virtual space as long as a condition for participation is satisfied.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a Continuation application of U.S. Ser. No.17/418,524, filed on Jun. 25, 2021, which is a national stage entry ofPCT/JP2019/050682, filed on Dec. 24, 2019, which claims priority to andbenefit of Japanese Patent Application No. 2018-248253, filed on Dec.28, 2018. The entire contents of each of the above are incorporatedherein by reference.

TECHNICAL FIELD

The present disclosure relates to a video distribution system, a videodistribution method, and a storage medium storing thereon videodistribution program, for live distributing a video containing ananimation of a character object generated based on motion of adistributor user.

BACKGROUND

Video distribution systems have been known that generate an animation ofa character object based on motion of a distributor user and livedistribute a video including the animation of the character object. Suchvideo distribution systems are disclosed, for example, in JapanesePatent Application Publication No. 2015-184689 (Patent Literature 1) and“Hasegawa Yusuke, Beginning of New Era of Virtual Idle, PROJECT MariA,CG WORLD, Japan, Bone Digital Co., Ltd., Nov. 10, 2017, Vol. 231, pp.74-79.”

As disclosed in Japanese Patent Application Publication No. 2012-120098(Patent Literature 2), another video distribution system is also knownthat, in response to a request from a viewer user watching a video, cancause an image containing an avatar of the viewer user to be displayedin a background region of the video being distributed. The viewer useris able to post his/her comment via the avatar on the video. In thismanner, the viewer user can use his/her avatar to participate in thevideo being distributed.

Japanese Patent Application Publication No. 2017-187995 (PatentLiterature 3) discloses a social media system that enables a pluralityof users to make voice communication using avatar images staying in avirtual room. The social media system disclosed in this Publicationimposes an upper limit on the number of avatars that are allowed to stayin each room. When an entry request is made for a certain room, theentry request is granted if the number of avatars that are already inthe room does not exceed the upper limit imposed on the room. If theentry request for the room is granted, a new avatar is permitted toenter the room.

CITATION LIST Patent Literature

-   Patent Literature 1: Japanese Patent Application Publication No.    2015-184689-   Patent Literature 2: Japanese Patent Application Publication No.    2012-120098-   Patent Literature 3: Japanese Patent Application Publication No.    2017-187995

Non-Patent Literature

-   Non-Patent Literature 1: Hasegawa Yusuke, Beginning of New Era of    Virtual Idle, PROJECT MariA, CG WORLD, Japan, Bone Digital Co.,    Ltd., Nov. 10, 2017, Vol. 231, pp. 74-79., Ltd., Nov. 10, 2017, Vol.    231, pp. 74-79.”

SUMMARY OF INVENTION Technical Problem

Video distribution systems encounter the problem of high processing loadrequired to display a large number of avatars if an unlimited number ofavatars are permitted to participate in a video being distributed. Inaddition, an increased number of avatars may disadvantageously result inincreased processing load for comment posting and gifting via theavatars. Too high processing load relating to the behaviors of theavatars may hinder playback of distributed videos and normal provisionof communicating functions using the avatars.

On the other hand, if the distribution systems allow only a limitednumber of avatars to participate in the video being distributed, thismay prevent participation of viewer users who are highly engaged withthe distribution systems or the distributor user responsible for thedistribution of the video. For the video distribution system, it isconsidered important to acquire and keep highly engaged viewer users forthe purposes of achieving more vigorous community involving thedistributor and viewer users and managing the community in a soundmanner.

Solution to Problem

It is an object of the present disclosure to provide a technicalimprovement which solves or alleviates at least part of the drawbacks ofthe prior art mentioned above. In particular, one object of thedisclosure is to provide a video distribution system, a videodistribution method and a video distribution program, capable ofreducing an increase in processing load caused by participation ofavatars while avoiding rejection of participation request made by highlyengaged viewer users.

One aspect of the invention relates to a video distribution system forlive distributing a video containing a virtual space and an animation ofa character object generated based on motion of a distributor user. Thevideo distribution system includes one or more computer processors. Theone or more computer processors execute computer-readable instructionsto determine, when receiving from a viewer user watching the video aparticipation request to request participation in the video, which oneof first and second groups the viewer user belongs to, to arrange, ifthe viewer user is determined to belong to the first group, a specificavatar of the viewer user in a first region within the virtual space,and to arrange, if the viewer user is determined to belong to the secondgroup, the specific avatar in a second region within the virtual spaceas long as a condition for participation is satisfied.

In one embodiment, in the virtual space, the first region is closer tothe character object than is the second region.

In one embodiment, the condition for participation is defined such thatthe number of avatars displayed in the second region and representingusers other than the viewer user is less than an upper limit on adisplayable number set for the second region.

In one embodiment, the condition for participation is defined such thatthe viewer user is selected by the distributer user.

The video distribution system relating to one embodiment furtherincludes a storage for storing therein avatar data used to display thespecific avatar in the virtual space and displays the specific avatar inthe virtual space based on the avatar data read from the storage.

The video distribution system relating to one embodiment receives amotion instruction targeting the specific avatar arranged in the virtualspace, and controls motion of the specific avatar displayed in thevirtual space based on the motion instruction.

The video distribution system relating to one embodiment receives adisplay request targeting the specific avatar while the specific avataris arranged in the virtual space, and, if the display request isapproved, displays the specific avatar in a third region where thecharacter object is arranged.

In one embodiment, the specific avatar is arranged in the third regionif the viewer user is selected by the distributor user after the displayrequest targeting the specific avatar is received.

In another aspect of the invention, provided is a video distributionmethod performed by one or more computer processors executingcomputer-readable instructions to live distribute a video containing ananimation of a character object generated based on motion of adistributor user. The video distribution method includes steps ofdetermining, when receiving from a viewer user watching the video aparticipation request to request participation in the video, which oneof first and second groups the viewer user belongs to, arranging, if theviewer user is determined to belong to the first group, a specificavatar of the viewer user in a first region within the virtual space,and arranging, if the viewer user is determined to belong to the secondgroup, the specific avatar in a second region within the virtual spaceas long as a condition for participation is satisfied.

In yet another aspect of the invention, provided is a video distributionprogram for live distributing a video containing an animation of acharacter object generated based on motion of a distributor user. Thevideo distribution program causes one or more computer processors todetermine, when receiving from a viewer user watching the video aparticipation request to request participation in the video, which oneof first and second groups the viewer user belongs to, to arrange, ifthe viewer user is determined to belong to the first group, a specificavatar of the viewer user in a first region within the virtual space,and to arrange, if the viewer user is determined to belong to the secondgroup, the specific avatar in a second region within the virtual spaceas long as a condition for participation is satisfied.

Advantageous Effect of Invention

An embodiment of the present invention can reduce an increase inprocessing load caused by participation of avatars while avoidingrejection of participation request made by highly engaged viewer users.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a video distribution system inone embodiment.

FIG. 2 schematically illustrates an installation of a studio where avideo to be distributed in the video distribution system of FIG. 1 isproduced.

FIG. 3 illustrates user data stored in the video distribution system ofFIG. 1 .

FIG. 4 illustrates avatar data stored in the video distribution systemof FIG. 1 .

FIG. 5 illustrates participation management data stored in the videodistribution system of FIG. 1 .

FIG. 6 is used to illustrate a virtual space displayed in a videodistributed in the video distribution system of FIG. 1 .

FIG. 7A illustrates an example view displayed on a client device 10 a inone embodiment. In the view shown in FIG. 7A, a participation requestbutton for enabling an avatar to participate in a video is displayed.

FIG. 7B illustrates an example view displayed on the client device 10 ain one embodiment. In the view shown in FIG. 7B, a display requestbutton for requesting that an avatar be displayed together with acharacter of a distributer user is displayed.

FIG. 7C shows an example view containing an image of a virtual spacecaptured by a different virtual camera.

FIG. 7D shows an example view containing an image of the virtual spacecaptured by a further different virtual camera.

FIG. 7E shows an example view showing that a feature request has beenmade.

FIG. 7F illustrates an example view where an avatar and a character of adistributer user are displayed together.

FIG. 8 is a flow chart showing a flow of a video distribution process inone embodiment.

FIG. 9 is a flow chart showing a flow of a procedure of processing aparticipation request made by an avatar in one embodiment.

FIG. 10 is a flow chart showing a flow of a procedure of processing adisplay request made by an avatar in one embodiment.

FIG. 11 is a block diagram illustrating a video distribution system inanother embodiment.

DESCRIPTION OF EMBODIMENTS

Various embodiments of the disclosure will be described hereinafter withreference to the accompanying drawings. Throughout the drawings, thesame or similar elements are denoted by the same reference numerals.

With reference to FIGS. 1 to 6 , a video distribution system accordingto an embodiment will be described. FIG. 1 is a block diagramillustrating a video distribution system 1 according to one embodiment,FIG. 2 schematically illustrates an installation of a studio where avideo to be distributed in the video distribution system 1 is produced,FIGS. 3 to 5 are used for describing the information stored in the videodistribution system 1, and FIG. 6 schematically shows a virtual spacedisplayed in a video.

The video distribution system 1 includes client devices 10 a to 10 c, aserver device 20, a studio unit 30, and a storage 25. The client devices10 a to 10 c, the server device 20, and the storage 25 are communicablyinterconnected over a network 15. The server device 20 is configured todistribute a video including an animation of a character, as describedlater. The character included in the video may be motion-controlled in avirtual space.

The video may be distributed from the server device 20 to each of theclient devices 10 a to 10 c. A first viewer user who is a user of theclient device 10 a, a second viewer user who is a user of the clientdevice 10 b, and a third viewer user who is a user of the client device10 c are able to watch the distributed video with their respectiveclient devices. The video distribution system 1 may include less thanthree client devices, or may include more than three client devices.Viewer users collectively refer to the users who use the client devices10 a to 10 c and other client devices to watch the video distributedfrom the server device 20. The users may watch the video distributedfrom the server device 20 through the client devices 10 a to 10 c, whereapplication software enabling the users to view the video is executable.To watch the video distributed from the server device 20, the users may,onto the client devices 10 a to 10 c, download and install applicationsoftware including a set of instructions implementing the video viewingfunction. The application software providing the function of watchingthe video distributed from the server device 20 may be referred to as“watching application software” or “watching app.” The users may watchthe video distributed from the server device 20 by executing thefunctions of the watching app. In one embodiment, the users may watchthe video distributed from the server device 20 on one or more of theclient devices 10 a to 10 c that has the watching app installed thereinand may not be able to watch the video on one or more of the clientdevices 10 a to 10 c without the watching app being installed. Theviewer user watching the video distributed from the server device 20 canhave his/her avatar displayed in the video. In other words, the vieweruser can use his/her avatar to participate in the video beingdistributed. The viewer user can have his/her avatar displayed in thevideo being distributed and use the displayed avatar to interact withthe distributer user of the video (or the character in the video beingdistributed) and with other viewer users.

The client devices 10 a to 10 c are information processing devices suchas smartphones. In addition to the smartphone, the client devices 10 ato 10 c each may be a mobile phone, a tablet, a personal computer, anelectronic book reader, a wearable computer, a game console, or anyother information processing devices that are capable of playing videos.Each of the client devices 10 a to 10 c may include a computerprocessor, a memory unit, a communication I/F, a display, a sensor unitincluding various sensors such as a gyro sensor, a sound collectingdevice such as a microphone, and a storage for storing variousinformation.

The display of the client devices 10 a to 10 c includes a display paneland a touch-screen panel. The touch-screen panel is configured to detecttouch interactions (touch operations) performed by a user. Thetouch-screen panel is capable of detecting various touch operations suchas tapping, double tapping, and dragging performed by the user. Thetouch-screen panel may include a capacitive proximity sensor and may becapable of detecting a non-contact operation performed by the user.

Viewer users can input a message regarding the distributed video orother messages via the respective touch-screen panels of the clientdevices 10 a to 10 c. The message may be, for example, a text message, astill image message, a moving image message, and any other electronicmessage. Each of the client devices 10 a to 10 c may be configured topost (send) the message input by the viewer user to the server device20.

In the illustrated embodiment, the server device 20 includes a computerprocessor 21, a communication I/F 22, and a storage 23.

The computer processor 21 is a computing device which loads an operatingsystem and various programs realizing various functions from the storage23 or other storage into a memory unit and executes instructionsincluded in the loaded programs. The computer processor 21 is, forexample, a CPU, an MPU, a DSP, a GPU, any other computing device, or acombination thereof. The computer processor 21 may be realized by meansof an integrated circuit such as ASIC, PLD, FPGA, MCU, or the like.Although the computer processor 21 is illustrated as a single componentin FIG. 1 , the computer processor 21 may be a collection of a pluralityof physically separate computer processors. In this specification, aprogram or instructions included in the program that are described asbeing executed by the computer processor 21 may be executed by a singlecomputer processor or executed by a plurality of computer processors ina distributed manner. Further, a program or instructions included in theprogram executed by the computer processor 21 may be executed by aplurality of virtual computer processors. The computer processor 21realizes a plurality of functions, which will be described below.

The communication I/F 22 may be implemented as hardware, firmware, orcommunication software such as a TCP/IP driver or a PPP driver, or acombination thereof. The server device 20 is able to transmit andreceive data to and from other devices via the communication I/F 22.

The storage 23 is a storage device accessible by the computer processor21. The storage 23 is, for example, a magnetic disk, an optical disk, asemiconductor memory, or various other storage devices capable ofstoring data. Various programs may be stored in the storage 23. At leastsome of the programs and various data that may be stored in the storage23 may be stored in a storage (for example, a storage 25) that isphysically separated from the server device 20. The data stored in thestorage 23 will be described below in detail.

Most of components of the studio unit 30 are disposed, for example, in astudio room R shown in FIG. 2 . As illustrated, an actor A1 givesperformance in the studio room R. The studio unit 30 is configured todetect motions and facial expressions of the actor A1 and to output thedetected information to the server device 20.

The actor A1 is an object whose motions and facial expressions arecaptured by a group of sensors provided in the studio unit 30, whichwill be described later. In the illustrated embodiment, the actor A1 isa human who talks, gives a performance, and performs other actions foradvancing a program distributed as the video. The actor A1 may be ananimal or any other moving (non-living) object, if not a human. Theactor A1 may be, for example, an autonomous robot. The number of actorsin the studio room R may be one or three or more.

The studio unit 30 includes six motion sensors 31 a to 31 f attached tothe actor A1, a controller 33 a held by the left hand of the actor A1, acontroller 33 b held by the right hand of the actor A1, a camera 37 aattached to the head of the actor A1 via an attachment 37 b, and awristwatch-type actor device 91 worn on the left arm of the actor A1. Amicrophone for collecting audio data may be provided to the attachment37 b. The microphone can collect speeches of the actor A1 as audio data.The microphone may be a wearable microphone attached to the actor A1 viathe attachment 37 b. Alternatively, the microphone may be installed onthe floor, wall or ceiling of the studio room R. In addition to thecomponents described above, the studio unit 30 further includes a basestation 35 a, a base station 35 b, a digital camera 36 a and a display39. A supporter computer 40 is installed in a room next to the studioroom R, and these two rooms are separated from each other by a glasswindow. The server device 20 may be installed in the same room as thesupporter computer 40.

The motion sensors 31 a to 31 f cooperate with the base station 35 a andthe base station 35 b to detect their position and orientation. In oneembodiment, the base station 35 a and the base station 35 b aremulti-axis laser emitters. The base station 35 a emits flashing lightfor synchronization and then emits a laser beam about, for example, avertical axis for scanning. The base station 35 b emits a laser beamabout, for example, a horizontal axis for scanning. Each of the motionsensors 31 a to 31 f may be provided with a plurality of optical sensorsfor detecting incidence of the flashing lights and the laser beams fromthe base station 35 a and the base station 35 b, respectively. Themotion sensors 31 a to 31 f each may detect its position and orientationbased on a time difference between an incident timing of the flashinglight and an incident timing of the laser beam, time when each opticalsensor receives the light and or beam, an incident angle of the laserlight detected by each optical sensor, and any other information asnecessary. The motion sensors 31 a to 31 f may be, for example, ViveTrackers provided by HTC CORPORATION. The base station 35 a and the basestation 35 b may be, for example, base stations provided by HTCCORPORATION.

Detection result information about the position and the orientation ofeach of the motion sensors 31 a to 31 f that are estimated in thecorresponding motion sensor is transmitted to the server device 20. Thedetection result information may be wirelessly transmitted to the serverdevice 20 from each of the motion sensors 31 a to 31 f. Since the basestation 35 a and the base station 35 b emit flashing light and a laserlight for scanning at regular intervals, the detection resultinformation of each motion sensor is updated at each interval. Three ormore base stations may be provided. The position of the base station maybe changed as appropriate. For example, in addition to or instead of thebase stations shown in FIG. 2 disposed at the upper corners of the spaceto be detected by the tracking sensor, a pair of the base stations maybe disposed at an upper position and a lower position close to thefloor. For example, there may be four base stations.

In the illustrated embodiment, the six motion sensors 31 a to 31 f aremounted on the actor A. The motion sensors 31 a, 31 b, 31 c, 31 d, 31 e,and 31 f are attached to the back of the left hand, the back of theright hand, the left instep, the right instep, the hip, and top of thehead of the actor A1, respectively. The motion sensors 31 a to 31 f mayeach be attached to the actor A1 via an attachment. The motion sensors31 a to 31 f shown in FIG. 2 are merely an example. The motion sensors31 a to 31 f may be attached to various body parts of the actor A1. Thenumber of motion sensors attached to the actor A1 may be equal to orless than 5, or equal to or more than 7. As described above, bodymotions of the actor A1 are detected by detecting the position and theorientation of the motion sensors 31 a to 31 f attached to the bodyparts of the actor A1. Body motions of the actor A1 may be detected byan optical motion capture system.

In one embodiment, a plurality of infrared LEDs are mounted on each ofthe motion sensors attached to the actor A1, and light from the infraredLEDs are sensed by infrared cameras provided on the floor and/or wall ofthe studio room R to detect the position and the orientation of each ofthe motion sensors. Visible light LEDs may be used instead of theinfrared LEDs, and in this case light from the visible light LEDs may besensed by visible light cameras to detect the position and theorientation of each of the motion sensors. As described above, a lightemitting unit (for example, the infrared LED or visible light LED) maybe provided in each of the plurality of motion sensors attached to theactor, and a light receiving unit (for example, the infrared camera orvisible light camera) provided in the studio room R senses the lightfrom the light emitting unit to detect the position and the orientationof each of the motion sensors.

In one embodiment, a plurality of reflective markers may be used insteadof the motion sensors 31 a-31 f. The reflective markers may be attachedto the actor A1 using an adhesive tape or the like. The position andorientation of each reflective marker can be estimated by capturingimages of the actor A1 to which the reflective markers are attached togenerate captured image data and performing image processing on thecaptured image data. In one embodiment, the body motions of the actor A1may be detected using a suit having inertia sensors embedded therein.The body motions of the actor A1 can be detected by analyzing sensorsignals output from the inertia sensors of theinertia-sensor-embedded-suit worn by the actor A1. Theinertia-sensor-embedded-suit can be an inertia-sensor-embedded-suitcompatible with MVN or a motion capture system developed by Xsens.com.

The controller 33 a and the controller 33 b supply, to the server device20, control signals that correspond to operation of the actor A1.

The digital camera 36 a captures images of the actor A1 and generatescaptured image data. The position, image capturing direction, and angleof view of the digital camera 36 a are set in accordance with operationof the operator. The digital camera 36 a transmits image-capturingconfiguration information that includes the position, image capturingdirection, and angle of view of the digital camera 36 a, to the serverdevice 20. Similarly, the position, image capturing direction, and anangle of view of the digital camera 36 b are set in accordance withoperation of the operator. In the illustrated embodiment, the digitalcamera 36 a is disposed on the left front of the actor A1.

The camera 37 a is attached to the head of the actor A1 as describedabove. For example, the camera 37 a is disposed so as to capture animage of the face of the actor A1. The camera 37 a captures successiveimages of the face of the actor A1 to obtain captured image data of theface of the actor A1. The camera 37 a transmits the captured image dataof the face of the actor A1 to the server device 20. The camera 37 a maybe a 3D camera capable of sensing the depth of a face of a human. Thecamera 37 a may be, for example, a LIDAR device built in iPhone X(registered trademark) provided by Apple Inc. The iPhone X (registeredtrademark) may be attached to, for example, a headgear worn on the headof the actor A1. The camera 37 a may be fixed to a camera standinstalled in the studio room R, instead of being mounted on the actorA1.

The display 39 is configured to display information received from thesupport computer 40. The information transmitted from the supportcomputer 40 to the display 39 may include, for example, textinformation, image information, and various other information. Thedisplay 39 is positioned such that the actor A1 is able to see thedisplay 39.

The actor device 91 is configured to generate a stimulus the actor A1can perceive, in response to a drive signal from the server device 20.The stimulus is not a sound. If the actor device 91 generates a sound,the sound may be included in contents to be distributed. For thisreason, the actor device 91 is configured to generate a stimulus otherthan a sound. The actor device 91 is capable of generating a stimulusother than an auditory stimulus (typically a sound), for example, atactile stimulus, a visual stimulus, or any other stimulus that can beperceived by the actor A1 and that is not an auditory stimulus. Theactor device 91 may include an actuator 91 a. The actuator 91 a isconfigured to be actuated in accordance with a drive signal from theserver device 20. The actuator 91 a may be configured to vibrate whenthe drive signal is supplied thereto. For example, Apple Watch providedby Apple Inc. may be used as the actor device 91. The actor device 91may be formed in various forms and shapes other than the wristwatchform. The actor A1 can wear two or more actor devices 91 of the sametypes or different types from each other. The actor device 91 may beconfigured to operate in response to a drive signal from a device otherthan the server device 20. Two or more actor devices 91 may beassociated with the actor ID that identifies the actor A1. The actordevice 91 is able to transmit a tactile stimulus to the actor A1 via theactuator 91 a. The actor device 91 may be an LED (Light Emitting Diode)or a perceptual display device. LEDs and perceptual display devices cangenerate visual stimuli. The perceptual display device may be anelectrotactile display that drives nerve axons under the skin withcurrent flowing from its electrode.

In the illustrated embodiment, the supporter computer 40 is installed inthe next room of the studio room R. Since the room in which thesupporter computer 40 is installed and the studio room R are separatedby the glass window, an operator of the supporter computer 40 (sometimesreferred to as “supporter” in the specification) is able to see theactor A1. In the illustrated embodiment, supporters B1 and B2 arepresent in the room as the operators of the supporter computer 40.

The supporter computer 40 may be configured to be capable of changingthe setting(s) of the component(s) of the studio unit 30 according tothe operation by the supporter B1 and the supporter B2. The supportercomputer 40 can change, for example, the interval of the scanningperformed by the base station 35 a and the base station 35 b, theposition or orientation of the digital camera 36 a and the trackingsensor 36 b, and various settings of other devices. Switching of activesensor(s), which will be described below, may be performed by thesupporters B1 and B2 operating the supporter computer 40. At least oneof the supporter B1 and the supporter B2 is able to input a message tothe supporter computer 40, and the input message is displayed on thedisplay 39.

The components and functions of the studio unit 30 shown in FIG. 2 aremerely example. The studio unit 30 applicable to the invention mayinclude various constituent elements that are not shown. The studio unit30 may include a projector. The projector is able to project a videodistributed to the client device 10 a or another client device on thescreen S.

On the other hand, shooting for generating a video to distribute may beperformed by simpler equipment. For example, by an informationprocessing terminal such as a smartphone, face motion data, which is adigital representation of the actor's facial movements, may be generatedand then an animation of a character object whose body stays still butits face moves in synchronization with the actor's facial expression maybe generated based on the face motion data. Such face motion data may begenerated by the client devices 10 a to 10 c. To generate the facemotion data, the user may, onto the client devices 10 a to 10 c,download and install application software including a set ofinstructions implementing the functions necessary to generate the facemotion data. The application software implementing the functionsnecessary to generate the face motion data may be referred to as the“distributing application software” or “distributing app.” Thedistributing app may be different application software from theabove-described watching app, or a single piece of application softwaremay have both the distributing app's functions and the above-describedwatching app's functions. The face motion data may include tracking dataconcerning the posture of the actor's head, feature points that aredigital representations of feature points of the actor's face, and blendface data representing deformation rates of the feature points. Aninformation processing terminal such as a smartphone may generate animage of the actor's face where the facial expression is exaggeratedbased on the face motion data, and may display the generated image suchthat the image is superimposed on the face of the character object. Whenan animation of a character object is generated based on face motiondata, the motion sensors 31 a, 31 b, 31 c, 31 d, 31 e, and 31 f, thebase stations 35 a and 35 b, and the digital cameras 36 a and 36 b fordetecting movements of the actor's body are not required so that theanimation of the character object can be generated with simplerequipment. If the motion sensors 31 a, 31 b, 31 c, 31 d, 31 e, and 31 f,the base stations 35 a and 35 b, and the digital camera 36 a are notrequired, generation of a character object can be performed in anyplaces in addition to the studio room R, for example, at the actor'shome. Therefore, convenience for the users is enhanced.

Next, the information stored in the storage 23 in one embodiment will bedescribed. In the illustrated embodiment, the storage 23 stores modeldata 23 a, object data 23 b, user data 23 c, avatar data 23 d,participation management data 23 e, and any other information requiredfor generation and distribution of videos to be distributed.

The model data 23 a is model data used for generating an animation of acharacter. The model data 23 a may be three-dimensional model data usedfor generating three-dimensional animation, or may be two-dimensionalmodel data used for generating two-dimensional animation. The model data23 a includes, for example, rig data (also referred to as “skeletondata”) indicating the skeleton of the character, and surface dataindicating the shape or texture of the surface of the character. Themodel data 23 a may include two or more different pieces of model data.The pieces of model data may each have different rig data, or may havethe same rig data. The pieces of model data may each have differentsurface data, or may have the same surface data.

The object data 23 b includes asset data used for constructing a virtualspace in the video. The object data 23 b includes data for rendering abackground of the virtual space in the video, data for rendering variousobjects to be displayed in the video, and data for rendering any otherobjects to be displayed in the video. The object data 23 b may includeobject position information representing the position of each object inthe virtual space.

In addition to the above, the object data 23 b may include data used fordisplaying a gift object in the video in response to a display requestmade by the viewer users of the client devices 10 a to 10 c. The giftobject may include an effect object, a normal object, and a decorativeobject. The viewer users are able to purchase a desired gift object.

The effect object is an object that affects the impression of the entireviewing screen of the distributed video, for example, an objectrepresenting confetti. The object representing confetti may be displayedon the entire viewing screen, which can change the impression of theentire viewing screen. The effect object may be displayed so as tooverlap with the character object, but it is different from thedecorative object in that it is not displayed in association with aspecific portion of the character object.

The normal object is an object functioning as a digital gift given fromthe viewer user to the actor (for example, the actor A1) or thecharacter in the video, for example, an object resembling a stuffed toyor a bouquet. In one embodiment, the normal object is displayed in aview showing the video such that it does not contact the characterobject. In one embodiment, the normal object is displayed in the viewshowing the video such that it does not overlap with the characterobject. The normal object may be displayed in the virtual space suchthat it overlaps with an object other than the character object. Thenormal object may be displayed so as to overlap with the characterobject, but it is different from the decorative object in that it is notdisplayed in association with a specific portion of the characterobject. In one embodiment, when the normal object is displayed such thatit overlaps with the character object, the normal object may hideportions of the character object other than the head including the faceof the character object but does not hide the head of the characterobject.

The decorative object is an object to be displayed in the view inassociation with a specific part of the character object. In oneembodiment, the decorative object to be displayed in the view inassociation with a specific part of the character object is displayed inthe view adjacent to the specific part of the character object. In oneembodiment, the decorative object to be displayed in the view inassociation with a specific part of the character object is displayed inthe view such that it partially or entirely covers the specific part ofthe character object.

The decorative object is an object that can be worn by a characterobject, for example, an accessory (such as a headband, a necklace, anearring, etc.), clothes (such as a T-shirt), a costume, and any otherobject which can be worn by the character object. The object data 23 bcorresponding to the decorative object may include wearing positioninformation indicating which part of the character object is associatedwith the decorative object. The wearing position information of thedecorative object may indicate to which part of the character object thedecorative object is to be worn. For example, when the decorative objectis a headband, the wearing position information of the decorative objectmay indicate that the decorative object is to be worn on the “head” ofthe character object. When the decorative object is a T-shirt, thewearing position information of the decorative object may indicate thatthe decorative object should be worn on the “torso” of the characterobject.

To each type of gift object, the duration of displaying the gift objectmay be assigned. In one embodiment, the duration of displaying thedecorative object may be set longer than the duration of displaying theeffect object and the duration of displaying the normal object. Forexample, the duration of displaying the decorative object may be set to60 seconds, while the duration of displaying the effect object may beset to 5 seconds and the duration of displaying the normal object may beset to 10 seconds.

The object data 23 b may include a list showing gift objects possessedby users of the video distribution system 1. In this possession list, anobject ID for identifying a gift object possessed by a viewer user maybe stored in association with account information of the viewer user.The account information of the user is, for example, a user IDidentifying the user. The users may include, for example, the first tothird viewer users of the client devices 10 a to 10 c.

As shown in FIG. 3 , the user data 23 c can include account informationof each of the users (for example, the viewer users) of the videodistribution system 1, avatar information relating to an avatar used byeach user, and group information relating to a group to which each userbelongs. In other words, the storage 23 can store therein, inassociation with the account information of each user of the videodistribution system 1, the avatar information relating to the avatarused by the user, the group information relating to the group to whichthe user belongs and any other information relating to the user. Theaccount information of a user is, for example, a user ID identifying theuser. The user ID of the user may be issued when the user signs up forthe video service provided by the server device 20 using any one of theclient devices 10 a to 10 c. To benefit from the service provided by theserver device 20, a common user ID may be used between when the watchingapp is used and when the distributing app is used, or different user IDsmay be used between when the watching app is used and when thedistributing app is used. When different user IDs are used to benefitfrom the service provided by the server device 20 between when thewatching app is used and when the distributing application is used, asingle user may be assigned with a user ID to use the watching app (auser ID for viewing) and a user ID to use the distributing app (a userID for distribution) that are stored in association with each other. Theservice provided by the server device 20 and received using the watchingapp is, for example, a service enabling a user to watch the videodistributed from the service device 20. The service provided by theserver device 20 and received using the distributing app is, forexample, a service enabling a user to distribute a video includinghis/her character object.

The avatar information of a user is, for example, an avatar IDidentifying the avatar used by the user in the video distribution system1. The avatar ID is assigned to the user if the user registers anavatar. The avatar is registered by the user selecting a head, a hairstyle, an outfit, accessories and any other parts to constitute theavatar. The avatar may be registered using the client devices 10 a to 10c having the distributing app installed therein. In other words, theavatar may be registered by executing the functions of the distributingapp. In one embodiment, the avatar can be registered using one or moreof the client devices 10 a to 10 c that have the distributing appinstalled therein and cannot be registered using one or more of theclient devices 10 a to 10 c that do not have the distributing appinstalled therein. The avatar may be registered through differentapplication software than the distributing application having functionsof generating, editing and/or registering avatars (hereinafter, may bereferred to as “the avatar generating application”). When the avatar isregistered through either the distributing app and/or avatar generatingapp, an avatar ID identifying the avatar may be assigned, associatedwith the user ID of the user and managed as part of the user informationas described above with reference to FIG. 3 . The user can edit theavatar after having registered the avatar. For example, afterregistering the avatar, the user can edit some or all of the parts ofthe avatar. For example, even after registering the avatar, the user canchange the hair style, belongings and any other parts constituting theavatar.

The group information of a user is a group ID identifying the group towhich the user belongs. The users of the video distribution system 1 canbelong to one of the groups including, for example, a first group and asecond group. The user of the video distribution system 1 belong toeither the first or second group. The second group is a group differentfrom the first group. Whether the user belongs to the first or secondgroup can be determined in various manners. The group ID is notnecessarily used to determine which one of the first and second groupsthe user belongs to. As an alternative example, the user data is made upby records configured such that a flag is set in the record of a userbelonging to the first group and no flag is set in the record of a userbelonging to the second group. In this manner, it can be known which oneof the first and second groups a user belongs to. Various criteria maybe used to determine which one of the groups a user belongs. Forexample, users who are relatively highly engaged with the videodistribution system 1 can be determined to belong to the first group,and users who are less engaged with the video distribution system 1 canbe determined to belong to the second group. The engagement of a user tothe video distribution system 1 can be represented in points, forexample. The points of the user may increase or decrease depending onhow the user uses the video distribution system 1. The points of theuser may increase if, for example, the user watches videos, distributesvideos, posts comments on videos, gifts something to distributorsdistributing videos, purchases gifts (gift objects), logs in the videodistribution system 1, starts the application software to watch videos,sends messages to other users via the social networking service providedby the video distribution system 1, receives positive evaluations fromother users on the social networking service and uses the videodistribution system 1 in any other ways. The points of the user maydecrease if, for example, the user is prohibited by distributors ofvideos from watching the videos (blocked), his/her posted comments aredeleted, the user receives negative evaluations from other users on thesocial networking service provided by the video distribution system 1,and the user uses the video distribution system 1 in any other manners.The user's behaviors related to the increase or decrease in points arenot limited to these. While the points possessed by the user mayincrease when the user's behavior strengthens the connection between theuser and the distributor user or other viewer users, the pointspossessed by the user may decrease when the user's behavior weakens theconnection between the user and the distributor user or other viewerusers.

In one embodiment, a smaller number of users belong to the first groupthan to the second group. When signing up for the video distributionsystem 1, a user is determined to belong to the second group. Afterstarting to use the video distribution system 1, the user may leave thesecond group and belong to the first group once s/he satisfies thecriteria of the first group. Alternatively, it is not determined whichgroup a user belongs when the user signs up for the video distributionsystem 1. The user may be determined to belong to the first group onlyif the user satisfies certain conditions after starting to use theservice. Whether or not a user belongs to the first group can bedetermined by, for example, referring to a flag that is set in the userdata and identifies the user as belonging to the first group. If newusers are determined to belong to the second group, the number of theusers belonging to the first group can be set smaller than the number ofthe users belonging to the second group. The group to which a userbelongs may depend on how the user uses the video distribution system 1.If a user no longer satisfies the criteria of the first group, the usermay leave the first group and newly belong to the second group.

In one embodiment, the criteria of the first group may be adjusted suchthat the number of users belonging to the first group remains less thanthe number of users belonging to the second group. For example, theserver device 20 monitors the number of users belonging to the firstgroup and the number of users belonging to the second group. If thedifference therebetween becomes smaller than a predetermined value, theserver device 20 may apply stricter criteria to classify the users intothe first group. An example case where a user who has 100 points or moreis initially classified into the first group is assumed. If thedifference between the number of users belonging to the first group andthe number of users belonging to the second group becomes smaller than apredetermined value, the criteria may be changed to classify a user intothe first group if the user has 200 points or more.

In one embodiment, there may be an upper limit on the number of theusers belonging to the first group. If such is the case, the users ofthe video distribution system 1 may be ranked according to their points,and the same number of users as the upper limit may be selected startingfrom the top if the ranking and determined to belong to the first group.Since it is not ensured that all of the highly ranked users log in thevideo distribution system 1, the logged-in users of the videodistribution system 1 may be ranked according to their points, and thesame number of users as the upper limit may be selected starting fromthe top of the ranking and determined to belong to the first group.

The grouping may be performed by referring to global or local points ofeach user. The global points may be globally used in the entire videodistribution system 1 and the local points may be locally administeredby each distributor user. For example, a user may be given local pointsfor a distributor user A and local points for a distributor user B thatare be separately administered. As for the videos distributed by thedistributor A (i.e., the videos including the character object of thedistributor A), the users may be ranked according to their local pointsadministered in relation to the distributor A, and the same number ofusers as the upper limit may be selected starting from the top of theranking and determined to belong to the first group. In this way, a usermay be determined to belong to the second group according to the rankingbased on the global points of the video distribution system 1 butdetermined to belong to the first group in relation to a particulardistributor user. If the local points are managed in this manner, theusers can be grouped in relation to each distributor user according totheir engagement in the distributor user.

As described above, when having points greater than a predeterminedthreshold value, a user is determined to belong to the first group. Whenhaving points less than the predetermined threshold value, on the otherhand, the user is determined to belong to the second group. In thismanner, users having points greater than the threshold value belong tothe first group and users having points less than the threshold valuebelong to the second group. In a case where the points indicate thelevel of the engagement in the video distribution system 1, relativelyhighly engaged users in the video distribution system 1 can belong tothe first group and less engaged users in the video distribution system1 can belong to the second group.

The manner of grouping the users is not limited to the examplesspecifically described in the specification. Alternatively, the usersmay be classified into three or more groups. In addition, anyclassification criteria for determining which group each user belongs tomay be modified as appropriate.

As shown in FIG. 4 , the avatar data 23 d can include avataridentification information of the avatar used by each user in the videodistribution system 1 and avatar display information used to display theavatar in the video. In other words, the storage 23 can store therein,in association with the avatar identification information of the avatar,the avatar display information used to display the avatar. The avataridentification information is, for example, an avatar ID identifying theavatar. The avatar is displayed in the video in the form of, forexample, an image resembling a human or animal. The avatar displayinformation is used to display the avatar within the video. The avatarinformation includes part information indicating images of partsconstituting the avatar, for example, the head, hair style, facial parts(eyes, nose, mouth and the like), torso, outfit, accessories, belongingsand the like. The user can register his/her avatar by selecting favoritepart images. The avatar display information may include 2D displayinformation used to display the avatar two-dimensionally in the videoand 3D display information used to display the avatarthree-dimensionally in the video. The 3D display information includespart information indicating the images of the parts used tothree-dimensionally display the avatar in the video, rig data used torepresent the three-dimensional motion of the avatar, and any otherknown information used to display the avatar three-dimensionally.

The viewer user can allow his/her avatar to participate in the videobeing distributed from the video distribution system 1. Theparticipation management data 23 e stored in the storage 23 is used tomanage the avatars participating in the video. As shown in FIG. 5 , theparticipation management data 23 e can include video identificationinformation identifying the video being distributed in the videodistribution system 1, participation limiting information designatingthe upper limit on the number of avatars that are allowed to participatein the video and participating avatar information indicating the avatarsparticipating in the video. The video identification information is, forexample, a video ID identifying the video. The participation limitinginformation for the video indicates, for example, an upper limit on thenumber of avatars that are allowed to participate in the video. Theparticipation limiting information may include a second upper limitindicating the upper limit on the number of avatars that are allowed tobe placed within a second region within the virtual space, which will bedescribed below. The participation limiting information may include afirst upper limit indicating the upper limit on the number of avatarsthat are allowed to be placed within a first region within the virtualspace, which will be described below. The participating avatarinformation for the video may indicate an avatar ID identifying theavatar participating in the video. When a plurality of avatarsparticipate in the video, the participating avatar information includesthe avatar ID of each avatar.

Functions realized by the computer processor 21 will be now describedmore specifically. The computer processor 21 functions as a body motiondata generation unit 21 a, a face motion data generation unit 21 b, ananimation generation unit 21 c, a video generation unit 21 d, a videodistribution unit 21 e, a gift processing unit 21 f, a participationrequest processing unit 21 g, an avatar displaying unit 21 h, an avatarcontrol unit 21 i and a display request processing unit 21 j byexecuting computer-readable instructions included in a distributionprogram. At least some of the functions that can be realized by thecomputer processor 21 may be realized by a computer processor other thanthe computer processor 21 of the video distribution system 1. Forexample, at least some of the functions realized by the computerprocessor 21 may be realized by a computer processor mounted on thesupporter computer 40 or any other not-shown computer processors. Forexample, when the client device 10 generates a video, the animationgeneration unit 21 c, video generation unit 21 d and any other functionsnecessary to generate a video by the client device 10 may be realized bythe computer processor provided in the client device 10.

The body motion data generation unit 21 a generates body motion data ofeach body part of the actor A1 based on detection result informationprovided by the corresponding one of the motion sensors 31 a to 31 f.The body motion data is serially generated with time as needed. Forexample, the body motion data may be generated at predetermined samplingtime intervals. Thus, the body motion data can represent body motions ofthe actor A1 in time series as digital data. In the illustratedembodiment, the motion sensors 31 a to 31 f are attached to the left andright hands and feet, waist and head of the actor A1. Accordingly, basedon the detection result information provided by the motion sensors 31 ato 31 f, it is possible to digitally represent the position andorientation of the substantially all body parts of the actor A1 in timeseries. The body motion data can define, for example, the position androtation angle of bones corresponding to the rig data included in themodel data 23 a.

The face motion data generation unit 21 b generates face motion data,which is a digital representation of the face motion of the actor A1,based on the captured image data provided by the camera 37 a. The facemotion data is serially generated with time as needed. For example, theface motion data may be generated at predetermined sampling timeintervals. Thus, the face motion data can digitally represent facialmotions (changes in facial expression) of the actor A1 in time series.

The animation generation unit 21 c is configured to apply the bodymotion data generated by the body motion data generation unit 21 a andthe face motion data generated by the face motion data generation unit21 b to predetermined model data included in the model data 23 a inorder to generate an animation of a character object that moves in avirtual space and whose facial expression changes. More specifically,the animation generation unit 21 c is capable of generating an animationof a character object whose body moves and whose facial expressionchanges in synchronization with the body motion and facial expression ofthe actor A1, based on the body motion data and face motion data of theactor A1.

The video generation unit 21 d constructs a virtual space using theobject data 23 b, and generates a video that includes the virtual spaceand the animation of the character object corresponding to the actor A1.More specifically, the video generation unit 21 d generates a sequenceof video frames including the virtual space and the animation of thecharacter object. The character object of the actor A1 may be positionedin the virtual space such that its position corresponds to the positionof the actor A1 relative to the digital camera 36 a.

In one embodiment, the video generation unit 21 d determinesconfiguration information of a virtual camera (its position in thevirtual space, gaze position, gazing direction, and angle of view),determines a rendering area in the entire virtual space based on theconfiguration information of the virtual camera and generates videoinformation used for displaying the rendering area of the virtual space.

The video generation unit 21 d is able to include, with the generatedvideo, voices of the actor A1 collected by the microphone in the studiounit 30. As described above, the video generation unit 21 d can generatethe animation of the character object moving in synchronization with thebody and face motion of the actor A1 and add the voices of the actor A1to the animation, thereby generating a video to be distributed.

The video generation unit 21 d can, before the video is distributed,load avatar display information required to display avatars that arepossibly to participate in the video. The video generation unit 21 d canload, of the avatar display information, the 3D display information thatrequires a lengthy time and high processing load to be loaded. Forexample, the video generation unit 21 d can read and load, from thestorage 23, avatar display information required to display the avatarsof the users belonging to the first group. In one embodiment, the videogeneration unit 21 d can read and load, from the storage 23, 3D displayinformation required to three-dimensionally display the avatars of theusers belonging to the first group.

In one embodiment, the video generation unit 21 d can load 3D displayinformation for avatars the number of which is equal to or less than thefirst upper limit. In one embodiment, the video generation unit 21 d canload 3D display information of avatars the number of which is equal toor less than the sum of the first and second upper limits.

The loaded avatar display information can be referred to when an avataris displayed in the video in response to a participation request made bya user. How to use the loaded avatar display information in order todisplay the avatar in the video will be described below.

The video distribution unit 21 e distributes the video generated by thevideo generation unit 21 d. The video is distributed to the clientdevices 10 a to 10 c and other client devices over the network 15. Thereceived video is reproduced on the client devices 10 a to 10 c. Thevideo may be distributed to a client device (not shown) installed in thestudio room R, and projected from the client device onto the screen Svia a short focus projector. The video may also be distributed to thesupporter computer 40. In this way, the supporters B1 and B2 can checkhow the distributed video appears on the screen.

A distributor user may refer to the user involved in the generationand/or distribution of the video distributed from the video distributionunit 21 e. In the above example, the video distributed from the serverdevice 20 includes the character object generated based on the bodymotion data and face motion data of the actor A1 and distributed withthe help of the supporters B1 and B2 when necessary. In this case, theactor A1 and supporters B1 and B2 may be each referred to as “adistributer user,” or the actor A1 and supporters B1 and B2 may becollectively referred to as “a distributer user.”

FIG. 6 schematically shows an example of the virtual space constructedby the video generation unit 21 d. The virtual space is defined as aspace shaped like the entire celestial sphere covering the centerthereof. A position in the virtual space is designated by coordinatevalues defined in a three-dimensional global coordinate system definedin the virtual space. For the sake of description, however, FIG. 6 onlyshows a part of the virtual space and does not show the coordinatesystem. FIG. 6 shows a hypothetical case where 10 users participate in avideo using their avatars.

In a virtual space 50 shown in FIG. 6 , a character object 51 of theactor A1, five virtual cameras 53 a to 53 e, a stage object 54representing the stage on which the character object 51 is arranged andavatar objects 56 a to 56 c, and 57 a to 57 g showing avatars arearranged. The stage object 54 includes a floor object 54 a correspondingto a floor of a studio on which the character object 51 stands and ascreen object 54 b extending perpendicularly from the floor object 54 aat one of the edges of the floor object 54 a that face each other in thehorizontal direction. For example, the floor object 54 a extendshorizontally in the virtual space, and the screen object 54 b extendsvertically in the virtual space. In the virtual space 50, a first region52 a and a second region 52 b are defined. In the illustratedembodiment, the avatar objects 56 a to 56 c are arranged in the firstregion 52 a, and the avatar objects 57 a to 57 g are arranged in thesecond region 52 b. In the virtual space 50, the first region 52 a isarranged closer to the character object 51 than is the second region 52b. In one embodiment, the character object 51 is arranged within thefloor object 54 a. Accordingly, the first region 52 a is closer to thefloor object 54 a than is the second region 52 b. The first and secondregions 52 a and 52 b may be positioned in the virtual space 50differently than in FIG. 6 . The first and second regions 52 a and 52 bmay be arranged at any position within the virtual space 50. Forexample, the first and second regions 52 a and 52 b may be arrangedwithin the floor object 54 a. For example, the first and second regions52 a and 52 b may be arranged, in the floor object 54 a, behind thecharacter object 51 from the perspective of the virtual camera 53 a. Inone embodiment, the first region 52 a is a region where the avatars ofthe users belonging to the first group are displayed, and the secondregion 52 b is a region where the avatars of the users belonging to thesecond group (or not belonging to the first group) are displayed. Asused herein, a third region may refer to the region where the characterobject 51 is arranged. In the illustrated example, the floor object 54 acorresponds to the third region. The virtual space 50 includes commentdisplay regions 55 a to 55 c where comments posted by users watching thevideo are displayed. The comment display regions 55 a to 55 c may beobjects in the virtual space 50. The virtual space 50 is not limited tothe embodiment explicitly described herein. The virtual space 50 caninclude various objects other than those explicitly described herein.

The virtual cameras 53 a to 53 e are positioned differently from eachother in the virtual space 50. The virtual cameras 53 a to 53 e are alloriented to face the character object 51. The images constituting thevideo generated by the video generation unit 21 d show a renderingregion that is part of the virtual space 50 and viewed from theperspective of a selected one of the virtual cameras 53 a to 53 e. Theconfiguration information of the virtual cameras 53 a to 53 e (itsposition in the virtual space, gazing position, gazing direction andviewing angle) may be changed by the actor A1, supporter B1, supporterB2 or any other operators manipulating the configuration informationwhile the video is being distributed.

As described above, three avatar objects 56 a to 56 c are arranged inthe first region 52 a, and seven avatar objects 57 a to 57 g arearranged in the second region 52 b. In one embodiment, the first andsecond upper limits are defined. The first upper limit denotes the upperlimit on the number of avatars that are allowed to be arranged in thefirst region 52 a, and the second upper limit denotes the upper limit onthe number of avatars that are allowed to be arranged in the secondregion 52 b. The first and second upper limits may be stored in thestorage 23 as part of the participation management data 23 e.

FIGS. 7A to 7F show, as an example, how the video generated by the videogeneration unit 21 d and distributed by the video distribution unit 21 eappears on the screen. FIGS. 7A to 7F show frame images (frames)constituting the video distributed by the video distribution unit 21 eand played back by the client devices 10 a to 10 c. The followingdescription is made assuming that the images shown in FIGS. 7A to 7F aredisplayed on the client device 10 a used by the first viewer user. Theview shown in FIG. 7A is displayed on the display of the client device10 a when the client device 10 a executes the watching app and playsback the video distributed from the server device 20. FIG. 7A shows, asan example, how an image 60 a appears. The image 60 a shows a renderingregion viewed from the perspective of the virtual camera 53 a. It is,however, assumed that the avatar 56 a of the first viewer user is notyet arranged within the virtual space 50 at the time of rendering theimage 60 a. In other words, the avatar 56 a is not arranged in a part ofthe virtual space 50 corresponding to the image 60 a.

As illustrated, the image 60 a includes the character object 51, thefloor object 54 a on which the character object 51 stands, and thescreen object 54 b defining the back edge of the stage. The image 60 aalso includes a display section 65 for displaying therein comments fromviewer users and notifications from the system.

The character object 51 is generated by applying the body motion dataand face motion data of the actor A1 to the model data for the actor A1included in the model data 23 a. The character object 51 ismotion-controlled based on the body motion data and face motion data.Thus, the character object 51 is controlled to move in the screen insynchronization with the body and face motions of the actor A1.

In the image 60 a, the objects arranged in the virtual space 50 appear,and manipulation buttons for receiving the user's manipulation may alsoappear. According to the example shown in FIG. 6 , the image 60 aincludes a gift button 61 for gifting, an evaluation button 62 formaking evaluation and an avatar participation button 63 for allowing anavatar to participate. Other manipulation buttons may appear in theimage 60 a.

The gift button 61 appears in the image 60 a such that it is selectableby an operation made on the client device 10 a displaying the image 60a. The gift button 61 may be selected, for example, by tapping a regionof a touch-screen panel of the client device 10 a where the gift button61 is displayed. In one embodiment, when the gift button 61 is selected,the view 60 a displays a window for selecting a gift to be gifted to thedistributor distributing the video being watched. The user of the clientdevice 10 a is able to select and purchase a gift to be gifted fromamong the gifts displayed in the window. In another embodiment, inresponse to the gift button 61 being selected, a window appears in theimage 60 a and presents a list of purchased gifts and/or a list ofselectable gifts. In this case, the user watching the video is able toselect a gift to be gifted from among the listed gifts appearing in thewindow. In one embodiment, when the gift button 61 is selected on theclient device 10, a gifting request may be transmitted to the serverdevice 60. The gifting request may include gift identificationinformation (a gift ID) that identifies a gift object corresponding to agift to be gifted. As described above, the viewer user watching thevideo can present a desired gift to the distributer user distributingthe video by selecting the gift button 61.

The gift processing unit 21 f receives the gifting request from theclient device 10 a of the user and processes the gifting request. Asdescribed above, the user watching the video is able to transmit agifting request to the server device 20 by operating his/her clientdevice.

In one embodiment, on reception of the gifting request, the giftprocessing unit 21 f refers to the gifting request to identify a giftobject to be gifted and performs display processing corresponding to theidentified gift object. As mentioned above, the gift object may includethe effect object, normal object, and decorative object. When the giftobject identified by the gifting request is an effect object, the giftprocessing unit 21 f performs processing to display the effect object inthe image 60 a of the video. For example, when a gifting request is madeto request an effect object corresponding to confetti, the giftprocessing unit 21 f displays in the image 60 a the effect objectresembling confetti based on the gifting request. In one embodiment,when receiving a gifting request to request a specific normal object,the gift processing unit 21 f performs processing to display in thevideo the normal object identified by the gifting request. For example,when a gifting request is made to request a normal object resembling astuffed bear, the gift processing unit 21 f displays in the image 60 athe normal object resembling a stuffed bear.

In one embodiment, when receiving a gifting request to request aspecific decorative object from the viewer user, the gift processingunit 21 f adds to a list of candidates the decorative object identifiedby the gifting request. The list of candidates is displayed, forexample, on the display of the supporter computer 40. The supporters B1and B2 can select a decorative object to be displayed in the video, fromthe list of candidates displayed on the display of the supportercomputer 40. The gift processing unit 21 f displays the selecteddecorative object in the view 60 a of the video. The selected decorativeobject is displayed in the image 60 a in association with a specificbody part of the character object 51. For example, when the decorativeobject is an object resembling a headband, the decorative object may beattached to the head of the character object 51. The decorative objectmay be displayed in the view 60 a such that it follows the movement ofthe specific body part of the character object. For example, when thehead of the character object 51 wearing the headband moves, the selecteddecorative object resembling the headband follows the motion of the headof the character object 51 as if the headband is worn on the head of thecharacter object 51.

The evaluation button 62 is displayed on the view 60 a such that it isselectable by the user using the client device 10 a. The evaluationbutton 62 may be selected, for example, by tapping a region of thetouch-screen panel of the client device 10 a where the evaluation button62 is displayed. When the evaluation button 62 is selected by the userwatching the video, evaluation updating information may be transmittedto the server device 20. The evaluation updating information mayindicate that positive evaluation has been made on the distributer userdistributing the video (for example, the actor A1) or on the video beingdistributed. Once the evaluation button 62 is selected, evaluationinformation indicating that negative evaluation has been made on thevideo may be transmitted to the server device 20.

The avatar participation button 63 is displayed in the view 60 a suchthat it is selectable by the first viewer user using the client device10 a. The avatar participation button 63 may be selected, for example,by tapping a region of the touch-screen panel of the client device 10 awhere the avatar participation button 63 is displayed. When the avatarparticipation button 63 is selected by the first viewer user watchingthe video, participation request to request participation of the avatarof the first viewer user in the video is transmitted to the serverdevice 20. The user who has transmitted the participation request byselecting the avatar participation button 63 may be referred to as “aparticipation applying user.” The participation request from theparticipation applying user may include a user ID identifying theparticipation applying user and an avatar ID identifying the avatar ofthe participation applying user. When the first viewer user selects theavatar participation button 63 but has not registered his/her avatar,the client device 10 a may display a view prompting the first vieweruser to register his/her avatar. In this case, the first viewer user canregister his/her avatar by following the guidance in the view.

The participation request processing unit 21 g receives theparticipation request made by the participation applying user anddetermines based on the participation request whether the avatar of theparticipation applying user can be displayed. In one embodiment, theparticipation request processing unit 21 g can determine which one ofthe first and second groups the participation applying user belongs. Forexample, the participation request processing unit 21 g refers to thegroup information of the user data 23 c to determine which one of thefirst and second groups the participation applying user belongs. Anexample case is assumed where the user information specifies that theuser belongs to the first group by setting a flag in the user ID, not inthe group ID. In this case, if such a flag is set for the participationapplying user, the participation applying user can be determined tobelong to the first group. If the flag is not set, on the other hand,the participation applying user can be determined to belong to thesecond group (or determined not to belong to the first group).

When the participation applying user is determined to belong to thefirst group, the participation request processing unit 21 g places theavatar of the participation applying user in the first region 52 a ofthe virtual space 50. For example, when the first viewer user transmitsa participation request through the client device 10 a and the firstviewer user is determined to belong to the first group, the avatar 56 acorresponding to the first viewer user is placed in the first region 52a as shown in FIG. 6 . When the first viewer user is determined tobelong to the first group, no additional conditions may be required andthe avatar 56 a of the first viewer user may be displayed in the firstregion 52 a. After approval is given to the participation of the avatar56 a of the first viewer user, some presentation effects may bedisplayed in relation to the participation of the avatar 56 a, beforethe avatar 56 a is arranged in the first region 52 a, or after theavatar 56 a is arranged in the first region 52 a. For example, in orderto allow the avatar 56 a to attract attention, presentation can be madesuch that spotlight is shed on the avatar 56 a. The presentationrelating to the participation of the avatar is not limited to theembodiment explicitly described herein.

When the participation applying user is determined to belong to thesecond group, the participation request processing unit 21 g determineswhether the participation applying user satisfies a condition forparticipation, and arranges the avatar of the participation applyinguser in the second region 52 b if it determines the participationapplying user satisfies the condition for participation. For example,when the first viewer user transmits a participation request through theclient device 10 a and the first viewer user is determined to belong tothe second group, the avatar 56 a is arranged in the second region 52 b,unlike the manner shown in FIG. 6 . When the avatar 56 a is arranged inthe second region 52 b, the above-described presentation effects can bealso displayed in the video.

When approval is given to the participation of the avatar in the videoin response to the participation request, the avatar may be prohibitedfrom participating in other videos. For example, when approval is givento the participation of the avatar in the video in response to theparticipation request, a flag is set as part of the avatar data 23 d inorder to indicate that the avatar is participating in the video and theflag may be referred to in order to determine whether approval should begiven to a participation request made by the user using the avatar torequest participation in other videos. Specifically, a case is assumedwhere an avatar participates in a video and the user of this avatarmakes a participation request to request participation in another video.If such is the case, the avatar data 23 d is referred to. If a flagindicating that the avatar is participating in the video is set, theparticipation request may be rejected. The procedure of prohibiting thesingle avatar from participating in two or more videos may be performedby the participation request processing unit 21 g.

As described above, when the participation applying user belongs to thesecond group, it is determined whether the participation applying usersatisfies a condition for participation. Next, a description is given ofthe condition for participation. In one embodiment, the condition forparticipation is defined such that the number of avatars arranged in thesecond region 52 b is less than the second upper limit defined for thesecond region 52 b. As an example, it is assumed that the second upperlimit on the number of the allowable avatars in the second region 52 bshown in FIG. 6 is seven. In this example, when a participation requestis received from a participation applying user belonging to the secondgroup, it is determined that the condition for participation is notsatisfied since the number of avatars (57 a to 57 g) arranged in thesecond region 52 b already reaches seven or the upper limit. In thiscase, no approval is given to the participation request made by theparticipation applying user and the avatar of the participation applyinguser is not placed in the virtual space 50. As another example, it isassumed that the second upper limit on the number of allowable avatarsin the second region 52 b shown in FIG. 6 is twelve. In this example,when a participation request is received from a participation applyinguser belonging to the second group, it is determined that the conditionfor participation is satisfied since the number of avatars (57 a to 57g) arranged in the second region 52 b is seven and less than the upperlimit. In this case, the avatar of the participation applying user isarranged in the second display region 52 b.

The avatars arranged in the first or second region 52 a or 52 b can stopparticipating in and leave the video in response to manipulation made bythe user using the avatar. For example, when the avatar 56 a of thefirst viewer user is arranged in the first or second region 52 a or 52 bof the video, the first viewer user can transmit to the server device 20an exit request to request exit of the avatar 56 a, by manipulating theclient device 10 a. When receiving the exit request, the server device20 (for example, the participation request processing unit 21 g) canperform a procedure of allowing the avatar 56 a of the first viewer userto exit the video, in response to the exit request. When an upper limitis defined for the number of avatars that are allowed to participate inthe first or second region 52 a or 52 b, other users' avatars areallowed to participate in the first or second region 52 a or 52 b oncethe avatar of the user who has made the exit request exits following theexit request. When the avatar exits the video, presentation effectsrelating to the exit of the avatar may be displayed in the video. Forexample, presentation can be made such that spotlight is shed on theexiting avatar. The presentation relating to the exit of the avatar isnot limited to the embodiment explicitly described herein.

In one embodiment, the procedure of allowing the avatar to exit thevideo may be performed when the user using the avatar ends the watchingapp being used to watch the video.

In another embodiment, even if the user whose avatar is participating inthe video terminates the use of the watching app to watch the video, theavatar may remain appearing in the video.

In another embodiment, the condition for participation is defined suchthat the participation applying user is selected by the distributoruser. The distributor user includes, for example, the actor A1 andsupporters B1 and B2. When receiving a participation request from agiven participation applying user, the participation request processingunit 21 g may generate a list of participation request users includingan indicator identifying the given participation applying user andpresent the list of participation request users to the distributor user.The list of participation request users for a video lists participationapplying users who have made a participation request for the video. Theparticipation request processing unit 21 g can transmit the list ofparticipation request user to the supporter computer 40. The supportersB1 and B2 can select a user who is approved of participation from thelist of participation request users displayed on the display of thesupporter computer 40. The list of participation request users may bedisplayed on the display 39 of the studio room R. The actor A1 mayselect a user who is approved of participating in the video, from thelist of participation request users, by manipulating the controller 33 aor 33 b. The participation request processing unit 21 g can place theavatar of the participation applying user selected by the distributoruser of the video (i.e., the participation applying user approved ofparticipating in the video) in the second display region 52 b.

The avatar displaying unit 21 h performs a procedure of displaying inthe image the avatar determined by the participation request processingunit 21 g to be arranged in the first and second regions 52 a and 52 b.For example, when displaying the avatar of the first viewer user in thefirst region 52 a, the avatar displaying unit 21 h consults the userdata 23 c to identify the avatar ID associated with the user ID of thefirst viewer user and then consults the avatar data 23 d to identify thepart information associated with the avatar ID. The avatar displayingunit 21 h constructs an avatar object representing the avatar of thefirst viewer user based on the identified part information and arrangesthe avatar object in the first region 52 a. In this way, when the firstregion 52 a is included within the rendering regions of the virtualcameras, the avatar object representing the avatar of the first vieweruser appears in the video. When the avatar is three-dimensionallydisplayed, the avatar object is constructed based on part informationfor 3D display. When the avatar is two-dimensionally displayed, theavatar object is constructed based on part information for 2D display.

The following describes, with reference to FIGS. 7B to 7D, an imagewhere the avatar 56 a of the first viewer user is arranged in the firstregion 52 a within the virtual space 50 since the first viewer userselects the avatar participation button 63. FIG. 7B shows an exampleimage 60 b rendered from the perspective of the virtual camera 53 a,similarly to the image 60 a shown in FIG. 7A. Accordingly, the positionsof the character object 51 and other objects in the image 60 b aresubstantially the same as the positions of the corresponding objects inthe image 60 a. Since the virtual camera 53 a is positioned between thefirst region 52 a and the character object 51, the avatar of the firstviewer user positioned in the first or second region 52 a or 52 b doesnot appear in the image 60 b showing the rendering region from theperspective of the virtual camera 53 a.

Another example view of the video in which the avatar 56 a of the firstviewer user is arranged in the first region 52 a within the virtualspace 50 is shown in FIG. 7C. Unlike the image shown in FIG. 7B, animage 60 c shown in FIG. 7C is rendered from the perspective of thevirtual camera 53 c. The virtual camera 53 c is arranged behind thecharacter object 51 on the right side to face the character object 51.Accordingly, the image 60 c rendered from the perspective of the virtualcamera 53 c includes the character object 51 seen from the right rearand the avatars 56 a to 56 c arranged in the first region 52 a.Considering the relative positions of the virtual camera 53 c, firstregion 52 a and second region 52 b, the image 60 c also shows some ofthe avatars arranged in the second region 52 b while being hidden behindthe avatars 56 a to 56 c. The avatars 56 a to 56 c and avatars 57 a to57 g may be two-dimensionally displayed. In this case, thetwo-dimensionally displayed avatars 56 a to 56 c and avatars 57 a to 57g appear in the virtual space 50 together with the otherthree-dimensionally displayed objects. If the avatars 56 a to 56 c andavatars 57 a to 57 g are two-dimensionally displayed, the rendering loadcan be reduced. It may be only the avatars 57 a to 57 g arranged in theback that are two-dimensionally displayed. Since the rendering load isreduced, this enables more avatars to be displayed on the screen. In oneembodiment, when the 3D display information of the avatars arranged inthe virtual space 50 is loaded onto the video generation unit 21 dbefore the start of the distribution of the video, the avatars can bethree-dimensionally displayed in the video. The avatar displaying unit21 h can see whether the 3D display information have been loaded for theavatars to be placed in the virtual space 50 in response to theirparticipation requests. If the 3D display information has been loadedfor the avatars to be placed in the virtual space 50 in response totheir participation requests, the avatar displaying unit 21 h maythree-dimensionally display the avatars in the video. If the 3D displayinformation has not been loaded for the avatars, the avatar displayingunit 21 h may two-dimensionally display the avatars in the video. In oneembodiment, the avatar displaying unit 21 h may runtime-load the 3Ddisplay information for the avatars to be placed in the virtual space 50in response to their participation requests and three-dimensionallydisplay the avatars in the video using the runtime-loaded 3D displayinformation. In other words, while the video is being distributed (inparallel with the distribution of the video), the server device 20 mayload the 3D display information of the avatars to be displayed in thevideo.

While an avatar is appearing in a video, the user of the avatar mayreplace the parts constructing the avatar with different options. Whenthe parts of the avatar appearing in the video are changed, the avatardisplaying unit 21 h can reflect the change, thereby changing theappearance of the avatar in the video. For example, the user may changethe hair style of his/her avatar from black hair to blond hair. In thiscase, the avatar displaying unit 21 h can reflect the change in theimage of the avatar appearing in the video, thereby changing theappearance of the avatar. The avatar displaying unit 21 h can reflect,real-time or quasi-real-time, other types of changes made in the avatarduring the distribution of the video than the change of parts in theavatar appearing in the video.

Still another example view of the video in which the avatar 56 a of thefirst viewer user is arranged in the first region 52 a within thevirtual space 50 is shown in FIG. 7D. An image 60 d shown in FIG. 7D isrendered from the perspective of the virtual camera 53 b. The virtualcamera 53 b is arranged in front of the character object 51, furtheraway from the character object 51 than is the virtual camera 53 a toface the character object 51. For this reason, the image 60 d renderedfrom the perspective of the virtual camera 53 b includes a larger partof the virtual space 50 than the images 60 a and 60 b. Specifically, theimage 60 d includes the first and second regions 52 a and 52 b.Accordingly, the image 60 d displays both the avatars 56 a to 56 carranged in the first region 52 a and the avatars 57 a to 57 g arrangedin the second region 52 b.

The image displayed on the client device 10 may show an emotion button68. The emotion button 68 enables the viewer user to express his/heremotion while watching the video. By selecting the emotion button 68,the viewer user is able to select his/her emotion such that he/she wasimpressed with the video, that he/she was not able to sympathize withthe video, or any other emotions of the viewer user. The emotion button68 can include an applause button for showing that the viewer user isimpressed by the video, a question mark button for showing that theviewer user does not sympathize with the video, a surprise button forshowing that the viewer user is surprised at the video, and any otherbuttons. Each emotion button 68 may include a representation of a symbolor graphics indicating an emotion to be selected by selecting theemotion button 68. For example, the applause button may include agraphic representation of hands clapping, the question mark button mayinclude a representation of a question mark, and the surprise button mayinclude a representation of an exclamation mark. The emotion button 68may be selected, for example, by tapping a region of the touch-screenpanel of the client device 10 a where the emotion button 68 isdisplayed. If the first viewer user watching the video selects theemotion button 68, an emotion display request is transmitted to theserver device 20. The emotion display request may include emotionidentification information indicating the type of the button selected bythe first viewer user via the emotion button 68 (the applause button,question mark button, surprise button or the like) selected by the firstviewer user. When the emotion button 68 is selected, a plurality ofbuttons (the applause button, surprise button and the like) associatedwith the emotion button 68 may pop up. When such a plurality of buttonsassociated with the emotion button 68 are displayed in pop-ups, the usercan select one of the buttons displayed in the pop-ups that correctlydescribes his/her emotion. The emotion button 68 may be displayed whenthe avatar of the user is participating in the video and may not bedisplayed when the avatar of the user is not participating in the video.For example, in the illustrated embodiment, the emotion button 68 is notdisplayed in the image 60 a since the avatar of the first viewer user isnot participating in the video when the image 60 a is displayed. Sincethe image 60 b and the other images are obtained while the avatar of thefirst viewer user is participating in the video, the emotion button 68appears in these images.

The avatar control unit 21 i may receive the emotion display requestfrom the first viewer user and control the behavior of the avatar of thefirst viewer user based on the received emotion display request. Forexample, when the emotion display request is transmitted in response tothe first viewer user selecting one of the emotion buttons or anapplause button, the avatar control unit 21 i can control the avatar 56a of the first viewer user to applaud based on the emotion displayrequest. When the avatar 56 is controlled to applaud based on theemotion display request, an animation showing the avatar 56 a applaudingmay appear in the video as long as the avatar 56 a is included in therendering region as is the case of FIG. 7C or 7D. If the avatar 56 a isnot included in the rendering region as is the case of FIG. 7B, on theother hand, an animation showing the avatar 56 a applauding may notappear while the sound of the applause of the avatar 56 a appears in thevideo. In one embodiment, the emotion button may be displayed in theview of the video being watched by the user only when the avatar of theuser appears in the video. For example, when the image 60 b shown inFIG. 7B is displayed on the client device 10 a of the first viewer user,the emotion button 68 may not appear in the image 60 b since the avatar56 a of the first viewer user is not displayed in the image 60 b. On theother hand, when the image 60 c shown in FIG. 7C is displayed on theclient device 10 a of the first viewer user, the emotion button 68 mayappear in the image 60 c since the avatar 56 a of the first viewer useris displayed in the image 60 c.

As described above, based on the emotion display request made by theuser, the avatar of the user claps hands or behaves in any other mannerin the video. The emotion display request is one type of motioninstructions to instruct the avatar to move. In other embodiments, theimage may include a motion instruction button to instruct the avatar tomove, in addition to the emotion button. The motion instruction buttonis designed to instruct the avatar to move. The motion instructionbutton may be used to instruct the avatar to move, for example, to jump,to wave his/her hands, to shake a cyalume and the like. If the motioninstruction button is selected, a motion instruction request istransmitted to the server device 20. The server device 20 can controlthe avatar to move in the manner requested by the motion instructionrequest.

As shown in FIGS. 7B to 7D, when the images 60 b to 60 d are displayed,the avatar participation button 63 does not appear in the image 60 b butinstead a display request button 64 appears since the avatar 56 a of thefirst viewer user is already in the virtual space 50. The displayrequest button 64 is designed to request that the avatar of a vieweruser be displayed along with the character object 51. The displayrequest button 64 is displayed in the view 60 b such that it isselectable by the first viewer user using the client device 10 a. Thedisplay request button 64 may be selected, for example, by tapping aregion of the touch-screen panel of the client device 10 a where thedisplay request button 64 is displayed. When the display request button64 is selected by the first viewer user watching the video, a displayrequest to request that the avatar 56 a of the first viewer user bedisplayed together with the character object 51 is transmitted to theserver device 20.

The display request processing unit 21 j receives the display requestfrom the first viewer user and, based on the display request, displaysthe avatar 56 a of the first viewer user in the video, together with thecharacter object 51. The request to request that an avatar be displayedtogether with a character object (for example, the character object 51)included in a video being distributed may be referred to as “a featurerequest,” and displaying the avatar together with the character object51 in response to the feature request may be referred to as “featuring”the avatar. During the featuring, only the avatar of the user who hasmade the feature request is displayed along with the character object 51and no other avatars may be displayed, as shown in FIG. 7F. As shown inFIG. 7E, when the user makes the feature request, a notification 66 maybe displayed in the image 60 e indicating that the feature request hasbeen made. The notification 66 may be displayed only in the imagedisplayed on the client device of the user who has made the featurerequest, or may be displayed not only in the image displayed on theclient device of the user but also in the image displayed on the clientdevice of another user. FIG. 7F shows an example image where the avatar56 a of the first viewer user and the character object 51 are bothdisplayed. In an image 60 f shown in FIG. 7F, the avatar 56 a of thefirst viewer user is displayed next to the character object 51. Thedisplay request processing unit 21 j may, based on the display requestfrom the first viewer user, display the avatar 56 a on the floor object54 a. Since the character object 51 is on the floor object 54 a, theavatar 56 a can be displayed together with the character object 51 ifthe avatar 56 a is arranged on the floor object 54 a. In the image 60 f,a notification 67 to notify that the featuring has been completed may bedisplayed.

When the avatar 56 a is displayed together with the character object 51based on the feature request, the avatar 56 a may be three-dimensionallydisplayed. As has been described, the avatar 56 a may betwo-dimensionally displayed in the image (for example, the image 60 c or60 d) observed before the feature request is made. Before the featurerequest is made, the avatar 56 a may be two-dimensionally displayed butmay be alternatively three-dimensionally displayed once the featuring iscompleted. Since the avatar 56 a is three-dimensionally displayed duringthe featuring, the image 60 b, which is displayed on the client device10 a of the first viewer user, may show the display request button 64only if the 3D display information for the avatar 56 a is loaded beforethe reception of the feature request.

In one embodiment, the display request button 64 appears in the imageintended for a user using an avatar for which the 3D display informationhas been loaded, and the display request button 64 does not appear inthe image intended for a user using an avatar for which no 3D displayinformation has been loaded. With such a design, the 3D displayinformation does not need to be runtime-loaded. This can reduce theprocessing load of the server device 20. In one embodiment, theruntime-loading may be avoided in the following manner since it requiresprocessing load. When a feature request is received for an avatar fromthe user, it is determined whether the 3D display information of theavatar has been loaded, and the avatar may be three-dimensionallydisplayed only when the 3D display information has been loaded. In thiscase, while the display request button 64 appears in the image intendedfor a user using an avatar for which the 3D display information has beenloaded, the display request button 64 does not appear in the imageintended for a user using an avatar for which no 3D display informationhas been loaded. Such a design can avoid fruitless transmission of afeature request and processing load resulting from such a featurerequest.

When the avatar is featured in the video, presentation effects relatingto the featuring of the avatar may be displayed in the video. Forexample, in order to allow the featured avatar to attract attention,presentation can be made such that spotlight is shed on the avatar. Whenthe featuring of the avatar is terminated, the same or differentpresentation effects can be displayed.

The display request processing unit 21 j may measure a time that haselapsed after the avatar 56 a of the first viewer user starts appearingin the video together with the character object 51. The display requestprocessing unit 21 j may display the elapsed time in the image 60 f. Inone embodiment, an upper limit may be set on the time during which thecharacter object 51 and the user's avatar are displayed together basedon the feature request (the duration of the featuring of the avatar).The display request processing unit 21 j may display the upper limit inthe image 60 f. The display request processing unit 21 j may calculate aremaining time during which the avatar 56 a is allowed to remaindisplayed based on the upper limit and the time that has elapsed afterthe avatar 56 a of the first viewer user starts appearing in the videotogether with the character object 51, and display the remaining time inthe image 60 f. The time that has elapsed since the avatar 56 a of thefirst viewer user starts appearing in the video together with thecharacter object 51, the upper limit imposed on the display time set forthe avatar 56 a and the remaining time during which the avatar 56 a isallowed to be displayed may be included only in the image 60 f displayedon the client device 10 a of the first viewer user, or may be includedin the image 60 f displayed on the client devices of the first vieweruser and other users. Since the upper limit is set on the duration ofthe featuring, more viewer users can be given opportunities to requestfeaturing in order to cause their avatars to appear together with thecharacter object 51. Since the remaining time is displayed for theongoing featuring, the viewer user can be notified of the time leftbefore featuring of the next avatar starts.

The display request processing unit 21 j can eliminate the participatingavatar from the video, based on an instruction from the distributor userof the video or other operators. The eliminated avatar is no longerdisplayed in the view of the video. Likewise, the display requestprocessing unit 21 j can eliminate the featured avatar from thefeaturing, based on an instruction from the distributor user of thevideo or other operators. The eliminated avatar is no longer displayedin the view of the featuring. The distributer user can eliminate, fromthe video and/or from the view of the featuring, an avatar who makes anundesirable comment in the video, an avatar who behaves unsuitably inthe video and other undesirable avatars in the video, for example.

In one embodiment, when a user's avatar is featured, the avatar controlunit 21 i can control the motion of the avatar based on an instructionfrom the user. For example, the avatar control unit 21 i can receive anemotion display request from the user of the featured avatar and controlthe behavior of the avatar based on the received emotion displayrequest. The avatar control unit 21 i may control the behavior of theavatar using the face or body motion transmitted from a terminal of theuser.

In one embodiment, when the feature request from the first viewer useris approved by the distributer user, the display request processing unit21 j may display the avatar 56 a of the first viewer user together withthe character object 51. In response to receiving the feature requestfrom the first viewer user, the display request processing unit 21 j mayinquire the distributer user as to whether the avatar 56 a of the firstviewer user is allowed to be displayed together with the characterobject 51. When receiving the feature request from the first vieweruser, the display request processing unit 21 j may generate a list ofdisplay request users including the first viewer user and present thelist of display request users to the distributor user. The list ofdisplay request users for a video shows a list of informationidentifying the users who have made the feature request (or theiravatars) (for example, their user ID, user name, nickname, avatar ID orany other information). The list of display request users may notinclude all of the users who have transmitted the feature request. Forexample, the list of display request users may include, from among theusers who have transmitted the feature request, only the users usingavatars for which the 3D display information has been already loaded. Inthis case, the list of display request users does not include, fromamong the users who have transmitted the feature request, theinformation identifying the users using avatars for which the 3D displayinformation has not been loaded. In order to three-dimensionally displaythe avatars for which the 3D display information has not been loaded,the 3D display information needs to be runtime-loaded. This enormouslyconsumes the processing resources of the server device 20. The runtimeloading can be avoided since the list of display request users includesonly the users using avatars for which the 3D display information hasbeen loaded.

The display request processing unit 21 j can transmit the list ofdisplay request users to the supporter computer 40. The supporters B1and B2 can select a user using an avatar who is approved of beingdisplayed together with the character object from the list of displayrequest users displayed on the display of the supporter computer 40. Thelist of display request users may be displayed on the display 39 in thestudio room R. The actor A1 may select a user who uses the avatar to bedisplayed together with the character object 51, from the list ofdisplay request users, by manipulating the controller 33 a or 33 b. Theuser selected from the list of display request users is now given apermission that his/her avatar can be displayed together with thecharacter object 51, and the avatar is featured in the video.

In one embodiment, if a user is selected from the list of displayrequest users, the selected user may be deleted from the list of displayrequest users. In another embodiment, if featuring of the avatar of auser is terminated, the user may be deleted from the list of displayrequest users. In this manner, after an avatar is featured once, theavatar can be prohibited from being repeatedly featured.

In one embodiment, while a user is being featured, a supporter ordistributer user may issue an instruction to select a to-be-featureduser from the list of display request users. In this case, however, theavatar of the selected user may not be immediately featured. Inaddition, the selected user may not be deleted from the list of displayrequest users until the featuring of the selected user's avatar isperformed.

Next, with reference to FIG. 8 , a video distribution process in oneembodiment will be described. FIG. 8 is a flow chart showing the flow ofthe video distribution process in one embodiment. In the videodistribution process, it is assumed that the actor A1 is present in thestudio room R.

First, in a step S11, the body motion data, which is a digitalrepresentation of the body motions of the actor A1, and the face motiondata, which is a digital representation of the facial motions (facialexpression) of the actor A1, are generated. The generation of the bodymotion data is performed, for example, by the body motion datageneration unit 21 a described above, and the generation of the facemotion data is performed, for example, by the face motion datageneration unit 21 b described above.

Next, in a step S12, the body motion data and face motion data of theactor A1 are applied to the model data for the actor A1 to generate ananimation of a character object that moves in synchronization with thebody and face motions of the actor A1. The generation of the animationis performed, for example, by the above-described animation generationunit 21 c.

In the next step S13, a video including the image of the virtual spaceand the animation of the character object corresponding to the actor A1is generated. The voices of the actor A1 may be included in the video.The animation of the character object corresponding to the actor A1 maybe provided in the virtual space. The generation of the video isperformed, for example, by the above-described video generation unit 21d.

Next, the process proceeds to a step S14 where the video generated inthe step S13 is distributed. The video is distributed to the clientdevices 10 a to 10 c and other client devices over the network 15. Thevideo may be distributed to the supporter computer 40 and/or may beprojected on the screen S in the studio room R. The video is distributedcontinuously over a predetermined distribution period. The distributionperiod of the video may be set to, for example, 30 seconds, 1 minute, 5minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any otherlength of time.

Subsequently in the step S15, it is determined whether a terminationcondition for ending the distribution of the video is satisfied. Thetermination condition is, for example, that the distribution ending timehas come, that the supporter computer 40 has issued an instruction toend the distribution, or any other conditions. If the terminationcondition is not satisfied, the steps S11 to S14 of the process arerepeatedly executed, and the video including the animation synchronizedwith the movements of the actor A1 continues to be distributed. If it isdetermined that the termination condition for the video is met, thedistribution process of the video is ended.

Next, with reference to FIG. 9 , a participation request process in oneembodiment will be described. FIG. 9 is a flow chart showing the flow ofthe participation request process in one embodiment. The participationrequest process shown in FIG. 9 assumes that the first viewer userwatching the video on the client device 10 a requests that the avatar 56a of the first viewer user participate in the video.

In the initial step S21, a participation request is received from thefirst viewer user. The participation request is transmitted from theclient device 10 a to the server device 20 when the first viewer userselects the avatar participation button 63 displayed on the clientdevice 10 a.

Subsequently, a step S22 identifies a group to which the user who hastransmitted the participation request belongs. In a case where everyuser belongs to either the first or second group, it is determined whichone of the first and second groups the first viewer user who hastransmitted the participation request belongs to. The determination ismade by, for example, the participation request processing unit 21 gdescribed above.

If it is determined that the first viewer user belongs to the firstgroup, the participation request process proceeds to a step S23. In thestep S23, the avatar 56 a of the first viewer user is arranged in thefirst region 52 a within the virtual space 50. As a result, when thefirst region 52 a is included within the rendering regions of thevirtual cameras, the avatar 56 a of the first viewer user appears in thevideo at a position corresponding to the first region 52 a. The avatar56 a is arranged in the first region 52 a by, for example, theparticipation request processing unit 21 g described above.

If it is determined that the first viewer user belongs to the secondgroup, the participation request process proceeds to a step S24. In thestep S24, it is determined whether the condition for participation issatisfied. As described above, the condition for participation isdefined such that the number of avatars arranged in the second region 52b is less than the second upper limit defined for the second region 52b, that the first viewer user is selected by the distributor user or thelike. The determination as to whether the condition for participation issatisfied is made by, for example, the participation request processingunit 21 g described above.

If it is determined that the condition for participation is satisfied,the participation request process proceeds to a step S25. In the stepS25, the avatar 56 a of the first viewer user is arranged in the secondregion 52 b within the virtual space 50. As a result, when the secondregion 52 b is included within the rendering regions of the virtualcameras, the avatar 56 a of the first viewer user appears in the videoat a position corresponding to the second region 52 b. The avatar 56 ais arranged in the second region 52 b by, for example, the participationrequest processing unit 21 g described above.

If it is determined that the condition for participation is notsatisfied, the avatar 56 a of the first viewer user is not displayed andthe participation request process ends. In another embodiment, if it isdetermined that the condition for participation is not satisfied,whether the condition for participation is satisfied may be repeatedlydetermined.

Next, with reference to FIG. 10 , a display request process in oneembodiment will be described. The display request process is a processof displaying the avatar arranged in the virtual space together with thecharacter object 51 (featuring the avatar) based on a display request(feature request) from the user of the avatar. FIG. 10 is a flow chartshowing the flow of the display request process in one embodiment. Thedisplay request process shown in FIG. 10 assumes that the first vieweruser watching the video on the client device 10 a makes a displayrequest to request that the avatar 56 a of the first viewer user bedisplayed together with the character object 51.

In a step S31, a display request is received from the first viewer user.The display request is transmitted from the client device 10 a to theserver device 20 when the first viewer user selects the display requestbutton 64 displayed on the client device 10 a.

In the next step S32, it is determined whether the display request fromthe first viewer user is permitted by the distributer user. If it isdetermined that the permission is given, the display request processproceeds to a step S33. The determination is made by, for example, thedisplay request processing unit 21 j described above.

In the step S33, operations are performed to display the avatar 56 a ofthe first viewer user together with the character object 51. Forexample, the avatar 56 a is arranged on the floor object 54 a, on whichthe character object 51 is arranged. The avatar 56 a is arranged on thefloor object 54 a by, for example, the display request processing unit21 j described above.

If it is determined that the distributor user does not give thepermission, the avatar 56 a of the first viewer user is not displayedtogether with the character object 51 and the display request processends. In another embodiment, the determining step S32 may be repeatedlyperformed until the distributer user gives the permission.

Next, a video distribution system 101 according to another embodiment ofthe invention will be described with reference to FIG. 11 . The videodistribution system 101 includes the server device 20 and a clientdevice 110. In the video distribution system 101, the client device 110generates (renders) a video (video frames) based on the data receivedfrom the server device 20. In order to enable the client device 110 togenerate a video, the server device 20 includes a display datatransmission unit 21 k for transmitting display data required by theclient device 110 to generate a video. Although not illustrated for thepurpose of simplifying the drawings, the service device 20 of the videodistribution system 101 may be capable of providing not only the displaydata transmission unit 21 k but also the same functions as the servicedevice 20 of the video distribution system 1. The display data has asmaller data size than the video frames to be generated based on thedisplay data. In the video distribution system 101, it is not therendered video frames but the display data that is transmitted from theserver device 20 to the client device 110. In this case, since therendering is performed in the client device 110, the communication loadcan be reduced. In addition, since the communication load is reduced,the video distribution system 101 can achieve less transmission delay.

The display data transmitted from the display data transmission unit 21k may include the body motion data of the actor generated by the bodymotion data generation unit 21 a, the face motion data generated by theface motion data generation unit 21 b, the object identificationinformation identifying the objects constituting the virtual space, theavatar identification information identifying the avatar to bedisplayed, and the gift identification information identifying the giftto be displayed. The display data may include voice informationrepresenting the voice of the actor. The object identificationinformation identifying an object may include coordinate informationindicating the position of the object within the virtual space.

When the server device 20 receives a gifting request from the clientdevice 10 a of the viewer user, the display data transmission unit 21 kcan incorporate, into the display data, gift identification informationidentifying a gift object requested by the gifting request to bedisplayed.

The display data transmission unit 21 k can incorporate, into thedisplay data, avatar identification information identifying an avatar ofa user who is approved by the participation request processing unit 21 gof participating. In addition to the avatar identification informationidentifying the avatar, the display data transmission unit 21 k mayincorporate, into the display data, display position informationindicating the position where the avatar is to be displayed in thevirtual space. The display position information indicating the displayposition of the avatar may indicate one of the first and second regions52 a and 52 b where the avatar is to be displayed.

When the server device 20 receives a gifting request from the clientdevice 10 a of the viewer user, the display data transmission unit 21 kcan incorporate, into the display data, gift identification informationidentifying a gift object requested by the gifting request to bedisplayed.

When the server device 20 receives from the viewer user a motioninstruction request targeting the avatar, the display data transmissionunit 21 k can incorporate, into the display data, the received motioninstruction request. In this case, the display data may include motionidentification information identifying the motion indicated by themotion instruction request.

When the server device 20 receives from the viewer user theabove-mentioned feature request, the display data transmission unit 21 kcan incorporate, into the display data, the received feature request. Inthis case, the display data may include viewer identificationinformation identifying the viewer user who has issued the featurerequest or avatar identification information identifying the avatar ofthis viewer.

The client device 110 is configured to generate a video based on thedisplay data received from the server device 20. The client device 110is an information processing device, such as a smartphone, capable ofgenerating a video based on the display data. Generating a video basedon the display data may be referred to as rendering. The client device110 includes a computer processor 121, a communication I/F 122, astorage 123 and a display 124. The client device 110 is able to transmitand receive data to and from other devices via the communication I/F122. The display 124 includes a display panel and a touch-screen panel.The client device 110 displays the generated video on the display 124.

The computer processor 121 is a computing device which loads variousprograms realizing an operating system and various functions from thestorage 123 or other storage into a memory unit and executesinstructions included in the loaded programs. The above descriptionabout the computer processor 21 may also apply to the computer processor121 to a maximum extent.

The storage 123 is a storage device accessible from the computerprocessor 121. The above description on the storage 23 also applies tothe storage 123 to a maximum extent. The storage 123 stores thereonmodel data 123 a, object data 123 b, avatar data 123 c and any othervarious information necessary to generate videos.

The model data 123 a is model data for generating an animation of acharacter. The description on the model data 23 a also applies to themodel data 123 a to a maximum extent. The model data 123 a can include,for example, rig data indicating a skeleton of a character, and surfacedata indicating the shape or texture of the surface of the character.

The object data 123 b includes asset data used for constructing avirtual space in the video. The description on the object data 23 b alsoapplies to the object data 123 b to a maximum extent. For example, themodel data 123 b may include data used to display a gift object.

The avatar data 123 c can include avatar identification informationidentifying the avatars used by the users and avatar display informationused to display the avatars within the videos. The description on theavatar data 23 d also applies to the avatar data 123 c to a maximumextent.

The storage 123 may store therein programs (may be referred to as “aphysics engine”) for simulating physical phenomena in the virtual space.The computer processor 121 can simulate the physical phenomena in thevirtual space by executing the physics engine.

The functions realized by the computer processor 121 will be nowdescribed more specifically. The computer processor 121 functions as ananimation generation unit 121 a, a video generation unit 121 b, a giftprocessing unit 121 c, an avatar displaying unit 121 d, an avatarcontrol unit 121 e and a display request processing unit 121 f byexecuting the computer-readable instructions included in thedistribution program. At least some of the functions that can berealized by the computer processor 121 may be realized by a computerprocessor other than the computer processor 121.

The animation generation unit 121 a is configured to generate ananimation of a character object based on the display data received fromthe server device 20. As described above, the display data may includethe body motion data and face motion data. The animation generation unit121 a can apply the body motion data and face motion data received inthe form of the display data to predetermined model data included in themodel data 123 a, thereby generating an animation of a character objectthat moves in the virtual space and whose facial expression changes.More specifically, the animation generation unit 121 a is capable ofgenerating an animation of a character object whose body and face movein synchronization with the body and face motion of the actor A1 basedon the body motion data and face motion data about the actor A1.

The video generation unit 121 b constructs the virtual space using theobject data 123 b, and generates a video that includes the virtual spaceand the animation of the character object corresponding to the actor A1.More specifically, the video generation unit 121 b generates a sequenceof successive video frames including the virtual space and the animationof the character object. The objects constituting the virtual space maybe identified based on the display data received from the server device20. The objects constituting the virtual space may be arranged in thevirtual space at the positions identified based on the display data.When the display data includes the voices of the actor A1, the videogeneration unit 121 b can combine the voices with the generated video.

The gift processing unit 121 c identifies a gift object to be displayedbased on the gift identification information included in the displaydata and performs display operations determined by the identified giftobject. The above description on the gift processing unit 21 f alsoapplies to the gift processing unit 121 c to a maximum extent. Forexample, the gift processing unit 121 c can display at least one of aneffect object, a normal object and a decorative object, based on thegift identification information included in the display data. The giftprocessing unit 121 c may execute the physics engine. For example, whenthe display data includes gift identification information identifying anormal object representing a stuffed bear, the gift processing unit 121c can simulate gravitational fall of the stuffed bear and display thenormal object representing the stuffed bear moving in the simulatedmanner in the video.

The avatar displaying unit 121 d performs operations to identify anavatar of a viewer user to be displayed based on the avataridentification information included in the display data and to displaythe identified avatar in the image. The display position of the avatarmay be determined based on the display position information of theavatar included in the display data.

When the display data includes motion identification information, theavatar control unit 121 e can control the avatar to move in the mannerindicated by the motion identification information. The avatar can movebased on the motion identification information, for example, jump, wavehis/her hands, shake a cyalume and the like.

When the display data includes a feature request, the display requestprocessing unit 121 f can, based on the feature request, display theavatar of the viewer user who has issued the feature request in thevideo, together with the character object.

Voice information may be transmitted from the server device 20 to theclient device 110, separately from the display data. In this case, theclient device 110 may combine the voice information and display data, togenerate a video.

As described above, the client device 110 can generate a video based onthe display data transmitted from the server device 20 and display thegenerated video on the display 124. The user of the client device 110can watch the video displayed on the display 124. The client device 110can serve in a similar manner as the client devices 10 a to 10 c, orprovide functions of enabling a user to interact with a character objectin a video or distributor. For example, the client device 110 canprovide functions of transmitting to the server device 20 a giftingrequest to give a gift, a participation request to request participationof its avatar in a video, and a feature request to request featuring ofits avatar. The client device 110 can serve in a similar manner as theclient devices 10 a to 10 c, or use a variety of services provided bythe server device 20.

As used in the specification and claims of the present application,“distribution of a video,” “live distribution of a video,” “todistribute a video” and “to live distribute a video” mean one or both ofa case where the video generated in the server device 20 is distributedor live distributed to the client device (for example, the client device10) and a case where a video is generated in a client device (forexample, the client device 110) based on the display data transmittedfrom the server device 20, unless otherwise construed from the context.As used in the specification and claims of the present application, “adistributed video” and “a live distributed video” mean one or both of avideo generated and distributed by the server device 20 and a videogenerated by the client device 110 based on the display data transmittedfrom the server device 20, unless otherwise construed from the context.Stated differently, when “a video is distributed,” the video may begenerated by either the server device 20 or client device.

Advantageous effects of the embodiments described above will be nowdescribed. In one embodiment described above, the video distributed bythe server device 20 may be watched by the first viewer user. When aparticipation request for the video is received from the first vieweruser, it is determined which one of the first and second groups thefirst viewer user belongs to. In one embodiment, if the first vieweruser is highly engaged with the video distribution system 1, 101 or thedistributer user distributing the video being watched, the first vieweruser is determined to belong to the first group. If the first vieweruser is determined to belong to the first group, the avatar 56 a of thefirst viewer user is arranged in the first region 52 a of the virtualspace 50. In one embodiment, if the first viewer user is determined tobelong to the first group, no additional conditions may not be requiredand the avatar 56 a of the first viewer user is arranged in the firstregion 52 a. With such a design, the embodiment does not hinder theavatar of the highly engaged user belonging to the first group fromparticipating in the video. In one embodiment, the number of usersbelonging to the first group can be limited to an appropriate numberdetermined by the video being distributed, by appropriately setting thecriteria for the first group. This can prevent a large number of avatarsfrom being displayed in a video being distributed, thereby reducing theprocessing load of the server device 20.

In one embodiment, if the first viewer user is determined to belong tothe second group, it is further determined whether the condition forparticipation is satisfied. If it is determined that the condition forparticipation is satisfied, the avatar 56 a of the first viewer user isarranged in the second region 52 b of the virtual space 50. In thismanner, the number of avatars displayed in the second region 52 b can belimited to an appropriate number by setting the condition forparticipation appropriately. As a result, the embodiment can reduce theprocessing load of the server device 20.

In one embodiment, the first region 52 a is closer in the virtual space50 to the character object 51 (or to the third region in which thecharacter object is arranged) than is the second region 52 b.Accordingly, the highly engaged viewer user can be arranged near thecharacter object 51. In one embodiment, the virtual cameras 53 a to 53 eare arranged in the virtual space 50 to face the character object 51.This means that an avatar arranged in the first region 52 a is morelikely to be included in the rendering region of the virtual camerasthan an avatar arranged in the second region 52 b. As noted, in oneembodiment, the avatar of the highly engaged user belonging to the firstgroup can be arranged in the first region 52 a so that it is more likelyto be included in the rendering region.

In one embodiment, the condition for participation is defined such thatthe number of avatars displayed in the second region 52 b is less thanthe upper limit imposed on the displayable number set for the secondregion 52 b. In this manner, the number of avatars displayed in thesecond region 52 b can be limited to the upper limit or less. As aresult, the embodiment can reduce the processing load of the serverdevice 20.

In one embodiment, the condition for participation is that the vieweruser is selected by the distributor user. With such a design, an avatarof a viewer user favorable for the distributor user is allowed toparticipate in a video. As a result, a healthy community can beestablished and maintained via a distributed video.

In one embodiment, a motion instruction is issued targeting an avatararranged in the virtual space 50 and received. The motion of the avataris controlled based on the motion instruction. With such a design, aviewer user who has issued the motion instruction targeting the avatarcan interact with a character included in the video and other viewerusers participating in the video.

In one embodiment, while an avatar of a viewer user is arranged in thevirtual space 50, a display request is received to request that theavatar be displayed together with the character object 51. If thedisplay request is approved, the avatar is displayed in the third regionwhere the character object 51 is arranged. With such a design, theviewer user can have a way of more intimately communicating with thecharacter of the distributer user.

Embodiments of the disclosure are not limited to the above embodimentsbut various modifications are possible within a spirit of the invention.For example, capturing and generating the images of the video to bedistributed may be performed in a site other than the studio room R. Forexample, capturing the images for generating the video to be distributedmay be performed at an actor's home or a supporter's home. The clientdevice 10, 110 may have a function of transmitting to a differentcommunicating device images where the avatar 56 a and the characterobject 51 are both displayed (for example, the image 600. For example,the first viewer user can use the functions of the client device 10, 110to distribute the images where the avatar 56 a and the character object51 are both displayed, through a social networking service included inthe video service provided by the server device 20 or through a socialnetworking service different from the video service provided by theserver device 20.

The procedures described herein, particularly those described with aflowchart, are susceptible of omission of part of the steps constitutingthe procedure, adding steps not explicitly included in the stepsconstituting the procedure, and/or reordering the steps. The proceduresubjected to such omission, addition, or reordering is also included inthe scope of the present invention unless diverged from the purport ofthe present invention.

REFERENCE SIGNS LIST

-   -   1, 101 video distribution system

1. A system for allowing viewing of a first video on a client device ofeach of a plurality of viewer users, the first video containing avirtual space and an animation of a character object generated based ona motion of a distributor user, the system comprising: one or morecomputer processors, wherein the one or more computer processors executecomputer-readable instructions to: in response to receiving aparticipation request for participation in the first video from a firstuser belonging to a first group among the plurality of viewer users,allow a first avatar of the first user to participate in the first videoby arranging the first avatar of the first user in a first region in thevirtual space; and in response to receiving a display request from thefirst user while the first avatar is arranged in the first region,generate a second video in which the first avatar is displayed alongwith the character object.
 2. The system of claim 1, wherein in thesecond video, the first avatar is arranged in a character display regionin which the character object is arranged.
 3. The system of claim 1,wherein in response to selection of a display request button displayedon a first client device of the first user, the display request isgenerated by the first client device.
 4. The system of claim 3, whereinin response to the first avatar participating in the first video, thedisplay request button is displayed on the first client device.
 5. Thesystem of claim 4, wherein the display request button is displayed onthe first client device only when 3D display information for displayingthe first avatar three-dimensionally is stored in a storage, and whereinthe first avatar is displayed three-dimensionally in the characterdisplay region in the second video.
 6. The system of claim 5, whereinthe first avatar is displayed two-dimensionally in the first region. 7.The system of claim 1, wherein an elapsed time after the first avatarbeing displayed along with the character object in the second video ismeasured, wherein a remaining time during which the first avatar isallowed to remain displayed along with the character object iscalculated based on the elapsed time, and wherein the remaining time isdisplayed on the client device along with the second video.
 8. Thesystem of claim 1, wherein the first avatar is eliminated from thesecond video based on an instruction from the distributor user.
 9. Thesystem of claim 1, wherein a motion of the first avatar is controlledbased on a motion instruction generated in response to selection of amotion instruction button displayed on the first client device.
 10. Thesystem of claim 9, wherein the motion instruction button is displayed onthe first client device only when the first avatar is participating inthe first video.
 11. The system of claim 1, wherein the first avatar isprohibited from participating in other videos different from the firstvideo while participating in the first video.
 12. The system of claim 1,wherein an upper limit of a number of users belonging to the first groupis less than an upper limit of a number of users belonging to a secondgroup different from the first group.
 13. The system of claim 1, whereinan upper limit of a number of users whose avatars are displayed alongwith the character object is less than an upper limit of a number ofusers belonging to the first group.
 14. A method performed by one ormore computer processors executing computer-readable instructions toallow viewing of a first video on a client device of each of a pluralityof viewer users, the first video containing a virtual space and ananimation of a character object generated based on a motion of adistributor user, the method comprising: in response to receiving aparticipation request for participation in the first video from a firstuser belonging to a first group among the plurality of viewer users,allowing a first avatar of the first user to participate in the firstvideo by arranging the first avatar of the first user in a first regionin the virtual space; and in response to receiving a display requestfrom the first user while the first avatar is arranged in the firstregion, generating a second video in which the first avatar is displayedalong with the character object.
 15. A non-transitory computer-readablestorage medium storing a program for allowing viewing of a first videoon a client device of each of a plurality of viewer users, the firstvideo containing a virtual space and an animation of a character objectgenerated based on a motion of a distributor user, the program causingone or more computer processors to: in response to receiving aparticipation request for participation in the first video from a firstuser belonging to a first group among the plurality of viewer users,allow a first avatar of the first user to participate in the first videoby arranging the first avatar of the first user in a first region in thevirtual space; and in response to receiving a display request from thefirst user while the first avatar is arranged in the first region,generate a second video in which the first avatar is displayed alongwith the character object.